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(57) Abstract: A processing system has an instruction 
pipeline (30) and a processor core. An instruction 
translator (42) for Uranslating non-native instnictions 
into native instruction operations is provided within the 
instruction pipeline downstream of the fetch stage (32). 
The instruction translator is able to generate multiple step 
sequences of native instruction operations in a manner 
that allows variable length native instruction operations 
sequences to be generated to emulate non -native 
instructions. The fetch stage is provided with a word buffer 
(62) that stores both a current instruction word and a next 
instruction word. Accordingly, variable length non-native 
instructions that span between instruction words read from 
the memory may be provided for inmiediate decode and 
multiple power consuming memory fetch avoided. 
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HARDWARE INSTRUCTION TRANSLATION WTTmN A PROCESSOR PIPELINE 

This invention relates to data processing systems. More particularly, this invention 
relates to data processing systems in which instruction translation from one instruction set to 
5 another instruction set occurs within a processor pipeline. 

It is known to provide processing systems in which instruction translation from a furst 
instruction set to a second instruction set takes place within the instruction pipeline. In these 
systems each instruction to be translated maps to a single native instruction. An example of 
10 such systems are the processors produced by ARM Limited that support both ARM and 
Thumb instruction codes. 

It is also known to provide processing systems in which non-native instructions may 
be translated into native instruction sequences comprising multiple native instructions. An 
15 example of such a system is described in US-A-5,937,193. This system maps Java bytecodes 
to 32-bit ARM instructions. The translation takes place before the instructions are passed into 
the processor pipeline and utilises memory address remapping techniques. A Java bytecode is 
used to look up a sequence of ARM instructions in a memory that then emulate the action of 
the Java bytecode. 

20 

The system of US-A-5,937,193 has several associated disadvantages. Such a system 
is inefficient in the way it utilises memory and memory fetches. The ARM instruction 
sequences all occupy the siame amount of memory space even if tiiey could be arranged to 
occupy less. Multiple fetches of ARM instructions from memory are required upon the 
25 decoding of each Java bytecode which disadvantageously consumes power and 
disadvantageous^ impacts performance. The translated instruction sequences are fixed 
making it difficult to take account of what may be different starting system states when 
executing each Java bytecode that could result in different, or better optimised, instruction 
translations. 

30 

Examples of known systems for translation between instruction sets and other 
background information may be found in the following: US-A-5,805,895; US-A-3,955,180; 
US-A-5,970,242; US-A-5,619,665; US-A-5,826,089; US-A-5,925,123; US-A-5,875,336; US- 
A.5,937,193; US-A-5,953,520; US-A-6,02 1,469; US-A-5,568,646; US-A-5,758,115; US-A- 
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5,367,685; IBM Technical Disclosure Bulletin, March 1988, pp308-309, "Systein/370 
Emulator Assist Processor For a Reduced Instruction Set Computer"; IBM Technical 
Disclosure Bulletin, My 1986, pp548-549, "Full Function Series/1 Instruction Set Emulator"; 
IBM Technical Disclosure Bulletin, March 1994, pp605-606, "Real-Time CISC Architecture 

5 HW Emulator On A RISC Processor"; IBM Technical Disclosure Bulletin, March 1998, 
p272, "Performance Improvement Usmg An EMULATION Control Block"; IBM Technical 
Disclosure Bulletin, January 1995, pp537-540, "Fast Instruction Decode For Code Emulation 
on Reduced Instoiction Set Computer/Cycles Systems"; IBM Technical Disclosure Bulletin, 
■ February 1993, pp23 1-234, "High Performance Dual Architecture Processor"; IBM Technical 

10 Disclosure Bulletin, August 1989, pp40-43, "System/370 I/O Channel Program Channel 
Command Word Prefetch"; IBM Technical Disclosure Bulletin, June 1985, pp305-306, 
"Fully Microcode-Controlled Emulation Architecture"; IBM Technical Disclosure Bulletin, 
March 1972, pp3074-3076, "Op Code and Status Handling For Emulation"; IBM Technical 
Disclosure Bulletin, August 1982, pp954-956, "On-Chip Microcoding of a Microprocessor 

15 With Most Frequently Used Instructions of Large System and Primitives Suitable for Coding 
Remaining Instructions"; IBM Technical Disclosure Bulletin, April 1983, pp5576-5577, 
"Emulation Instruction"; the book ARM System Architecture by S Furber; the book 
Computer Architecture: A Quantitative Approach by Hennessy and Patterson; and the book 
The Java Virtual Machine Specification by Tim Lmdhohn and Frank Yellin l" and 2"^ 

20 Editions. 

Viewed firom one aspect the present invention provides apparatus for processing data, 
said apparatus comprising: 

a processor core operable to execute operations as specified by instructions of a first 
25 instruction set, said processor core having an instruction pipeline into which instructions to be 
executed are fetched from a memory and along which instructions progress; and 

an instruction translator operable to translate instructions of a second instruction set 
into translator output signals corresponding to instructions of said first instruction set; wherein 

said instruction translator is within said instruction pipeline and translates instructions 
30 of said second instruction set that have been fetched into said instruction pipeline from said 
memory; 

at least one instruction of said second instruction set specifies a multi-step operation 
that requires a plurality of operations that may be specified by instructions of said first 
instruction set in order to be performed by said processor core; and 



2 



wo 02/29507 



PCT/GBOl/02743 



said instruction translator is operable to generate a sequence of translator output 
signals to control said processor core to perfom said multi-step operation. 

The present invention provides the instruction translator within the instruction pipeline 
5 of the processor core itself downstream of the fetch stage. In this way, the non-native 
instructions (second instruction set instructions) may be stored within the memory system in 
the same way as native instructions (first instruction set instructions) thereby removing what 
would otherwise be a constraint on memory system usage. Furthermore, for each non-native 
instruction, a single memory fetch of a non-native instruction from the memory system takes 
10 place with generation of any multi-step sequence of native instruction operations occurring 
within the processor pipeline. This reduces the power consumed by memory fetches and 
improves performance. In addition, the instruction translator within the pipeline is able to 
issue a variable number of native instruction operations down the remainder of the pipeline to 
be executed in dependence upon the particular non-native instruction being decoded and in 
15 dependence upon any surrounding system state that may influence what native operations 
may eflficientiy perform the desired non-native operation. 

It will be appreciated that the mstruction translator could generate translator output 
signals that fiilly and completely represent native instructions from the first instruction set 

20 Such an arrangement may allow the sunple re-\ise of hardware logic that was designed to 
operate with those instructions of the first instruction set. However, it will be appreciated that 
the instruction translator may also generate translator output signals that are control signals 
that can produce the same effect as native instructions without directiy corresponding to them 
or additionally provide further operations, such as extended operand field, that were not in 

25 themselves directly provided by instructions of the first instruction set. 

Providing the instruction translator within the instruction pipeline enables a program 
coimter value for the processor core to be used to fetch non-native instructions from the 
memory in a conventional manner as the translation into native instructions of non-native 
30 instructions takes place without reliance upon the memory organisation. Furthermore, the 
program counter value may be controlled so as to be advanced in accordance with the 
execution of non-native instructions without a dependence upon whether or not those non- 
native instructions translate into single step or multi-step operations of native instructions. 
Using the program counter value to track the execution of non-native instructions 
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advantageously simplifies methods for dealing with interrupts, branches and other aspects of 
the system design. 

Providing the instruction translator within the instruction pipeline, in a way which 
5 may be considered as providing a finite state machine, has the result that the instruction 
translator is more readily able to adjust the translated instruction operations to reflect the 
system state as well as the non-native instruction being translated. As a particularly preferred 
example of this, when the second instruction set specifies stack based processing and the 
processor core is one intended for register based processing, then it is possible to use a set of 
10 the registers to ejffectively cache stack operands in order to speed up processing. In this 
circumstance, the translated instruction sequences may vary depending upon whether or not a 
particular stack operand is cached within a register or has to be fetched. 

In order to reduce the impact that the instruction translator may have upon the 
15 execution of native instructions, preferred embodiments are such that the instruction translator 
within the instruction pipeline is provided with a bypass path such that, when operating in a 
native instruction processing mode, native instructions can be processed without being 
influenced by the instruction translator. 

20 It will be appreciated that the native instructions and the non-native instructions could 

take many dijBferent forms. However, the invention is particularly useful when the non-native 
instructions of the second instruction set are Java Virtual Machine instructions as the 
translation of these instructions into native instructions presents many of the problems and 
difficulties which the present invention is able to address. 

25 

Viewed from another aspect the present mvention provides a method of processing 
data using a processor core having an instruction pipeline into which instructions to be 
executed are fetched from a memory and along which instructions progress, said processor 
core being operable to execute operations specified by instructions of a first instruction set, 
30 said method comprising the steps of: 

fetching instructions into said instruction pipeline; an? 

translating fetched instructions of a second instruction set into translator output signals 
corresponding to instructions of said first instruction set using an instruction translator within 
said instruction pipeline; wherein 
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at least one instruction of said second instruction set specifies a multi-step operation 
that requires a plurality of operations that may be specified by instructions of said first 
instruction set in order to be performed by said processor core; and 

said instruction translator is operable to generate a sequence of translator output 
5 signals to control said processor core to perfomi said multi-step operation. 

The invention also provides a computer program product holding a computer program 
for controlling a computer in accordance with the above technique. 

10 When fetching instructions to be translated within an instruction pipeline a problem 

arises when the mstructions to be translated are variable length instructions. The fetch stage 
of an instruction pipeline has relatively predictable operation when fetching fixed length 
instructions. For example, if an instruction is executed on each instruction cycle, then the 
fetch stage may be arranged to fetch an instruction upon each instruction cycle m order to 

15 keep the instruction pipeline full. However, when the instructions being fetched are of a 
variable length, then there is a difficulty in identifying the boundaries between instructions. 
Accordingly, in memory systems that provide fixed length memory reads, a particular 
variable length instruction may span between memory reads requiring a second fetch to read 
the final portion of an instruction. 

20 

Viewed firom another aspect the invention provides apparatus for processing data, said 
apparatus comprising: 

a processor core operable to execute operations as specified by instructions of a first 
instruction set, said processor core having an instruction pipeline into which instructions to be 
25 executed are fetched from a memory and along which instructions progress; and 

an instruction translator operable to translate instructions of a second instruction set 
into translator output signals corresponding to instructions of said first instruction set; wherein 

said instructions of said second instruction set are variable length instructions; 

said instruction translator is within said instruction pipeline and translates mstructions 
30 of said second instruction set that have been fetched into a fetch stage of said instruction 
pipeline fi*om said memory; and 

said fetch stage of said instruction pipeline includes an instruction buffer holding at 
least a current instruction word and a next instmction word fetched from said memory such 
that if a variable length instruction of said second instruction set starts within said current 

5 
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instruction word and extends into said next instruction word, then said next instruction word 
is available within said pipeline for translation by said instruction translator without requiring 
a further fetch operation. 

5 The invention provides a buffer within the fetch stage storing at least a current 

instruction word and a next instruction word. In this way, if a particular variable length 
instruction extends out of the current instruction word into the next instruction word, then that 
instruction word has already been fetched and so is available for immediate decodmg and use. 
Any second, power inefficient fetch is also avoided. It will be appreciated that providing a 

10 fetch stage in the pipeline that buffers a next instruction word as well as the current 
instruction word and supports variable length instructions makes the fetch stage operate ia a 
more asynchronous manner relative to the rest of the stages within the instruction pipeline. 
This is counter to the normal operational trend within instruction pipelines for executing fixed 
length instructions in which the pipeline stages tend to operate in synchronism. 

15 

Embodiments of the invention that buffer instructions within the fetch stage are well 
suited to use within systems that also have the above described preferred features set out in 
relation to the first aspect of the invention. 

20 Viewed from another aspect the invention provides a method of processing data using 

a processor core operable to execute operations as specified by instructions of a first 
instruction set, said processor core having an instruction pipeline into which instructions to be 
executed are fetched from a memory and along which instructions progress, said method 
comprising the steps of: 

25 fetching instructions into said instruction pipeline; and 

translating fetched instructions of a second instruction set into translator output signals 
corresponding to instructions of said first instruction set using an instruction translator within 
said instruction pipeline; wherein 

said instructions of said second instruction set are variable length instructions; 

30 said instruction translator is within said instruction pipeline and translates instructions 

of said second instruction set that have been fetched into a fetch stage of said instruction 
pipeline from said memory; and 

said fetch stage of said instruction pipeline includes an instruction buffer holding at 
least a current instruction word and a next instruction word fetched from said memory such 
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that if a variable length instruction of said second instruction set starts within said current 
instruction word and extends into said next instruction word, then said next instruction word 
is available within said pipeline for translation by said instruction translator without requiring 
a further fetch operation. 

5 

Embodhnents of the invention wilt now be described, by way of example only, with 
reference to the accompanying drawings in which: 

Figures 1 and 2 schematically represent example instruction pipeline arrangements; 

10 

Figure 3 illustrates in more detail a fetch stage arrangement; 

Figure 4 schematically illustrates the reading of variable length non-native instructions 
from within buffered instruction words within the fetch stage; 

15 

Figure 5 schematically illustrates a data processing system for executing both 
processor core native instructions and instructions requiring translation; 

Figure 6 schematically illustrates, for a sequence of example instructions and states 
20 the contents of the registers used for stack operand storage, the mapping states and the 
relationship between instructions requiring translation and native instructions; 

Figure 7 schematically illustrates the execution of a non-native instruction as a 
sequence of native instructions; 

25 

Figure 8 is a flow diagram illustrating the way in which the instruction translator may 
operate in a manner that preserves interrupt latency for translated instructions;. 

Figure 9 schematically illustrates the translation of Java bytecodes into ARM opcodes 
30 - using hardware and software techniques; 
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Figure 10 schematically illustrates the flow of control between a hardware based 
translator, a software based interpreter and software based scheduling; 

Figures 1 1 and 12 illustrate another way of controlling scheduling operations using a 
5 timer based approach; and 

Figure 13 is a signal diagram illustrating the signals controlling the operation of the 
circuit of Figure 12. 

10 Figure 1 shows a first example instruction pipeline 30 of a type suitable for use in an 

ARM processor based system. The instruction pipeline 30 includes a fetch stage 32, a native 
instruction (ARM/Thumb instructions) decode stage 34, an execute stage 36, a memory 
access stage 38 and a write back stage 40. The execute stage 36, the memory access stage 38 
and the write back stage 40 are substantially conventional. Downstream of the fetch stage 32, 

15 and upstream of the native instruction decode stage 34, there is provided an instruction 
translator stage 42. The instruction translator stage 42 is a finite state machine that translates 
Java bytecode instructions of a variable length into native ARM instructions. The instruction 
translator stage 42 is capable of multi-step operation whereby a single Java bytecode 
instruction may generate a sequence of ARM instructions that are fed along the remainder of 

20 the mstruction pipeline 30 to perform the operation specified by the Java bytecode instruction. 
Simple Java bytecode instructions may reqmred only a single ARM instruction to perform 
their operation, whereas more complicated Java bytecode instructions, or in circumstances 
where the surrounding system state so dictates, several ARM instructions may be needed to 
provide the operation specified by the Java bytecode instruction. This multi-step operation 

25 takes place downstream of the fetch stage 32 and accordingly power is not expended upon 
fetching multiple translated ARM instructions or Java bytecodes from a memory system. The 
Java bytecode instructions are stored within the memory system in a conventional manner 
such that additional constraints are not provided upon the memory system in order to support 
the Java bytecode translation operation. 

30 

As illustrated, the instruction translator stage 42 is provided with a bypass path. When 
not operating in an instruction translating mode, the instruction pipeline 30 may bypass the 
instruction translator stage 42 and operate in an essentially unaltered manner to provide 
decoding of native instructions. 
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In the instruction pipeline 30, the instruction translator stage 42 is illustrated as 
generating translator output signals that fully represent corresponding ARM instructions and 
are passed via a multiplexer to the native instruction decoder 34. The mstruction translator 42 

5 also generates some extra control signals that may be passed to the native instmction decoder 
'34. Bit space constraints within the native instruction encoding may impose limitations upon 
the range of operands that may be specified by native instructions. These limitations are not 
necessarily shared by the non-native instructions. Extra control signals are provided to pass, 
additional instruction specifying signals derived from the non-native instructions that would 

10 not be possible to specify within native instructions stored within memory. As an example, a 
native instruction may only provide a relatively low number of bits for use as an immediate 
operand field within a native instruction, whereas the non-native instmction may allow an 
extended range and this can be exploited by using the extra control signals to pass the 
extended portion of the immediate operand to the native instruction decoder 34 outside of the 

15 translated native instruction that is also passed to the native instruction decoder 34. 

Figure 2 illustrates a further instruction pipeline 44. In this example, the system is 
provided with two native instruction decoders 46, 48 as well as a non-native instruction 
decoder 50. The non-native instruction decoder 50 is constrained in the operations it can 

20 specify by the execute stage 52, the memory stage 54 and the write back stagt 56 that are 
provided to support the native instmctions. Accordingly, the non-native instruction decoder 
50 must effectively translate the non-native instructions into native operations (which may be 
a single native operation or a sequence of native operations) and then supply appropriate 
control signals to the execute stage 52 to carry out these one or more native operations. It will 

25 be appreciated that in this example the non-native instruction decoder does not produce 
signals that fonn a native instruction, but rather provides control signals that specify native 
instruction (or extended native instruction) operations. The control signals generated may not 
match the control signals generated by the native instruction decoders 46, 48. 

30 In operation, an instmction fetched by the fetch stage 58 is selectively supplied to one 

of the instruction decoders 46, 48 or 50 in dependence upon the particular processing mode 
using the illustrated demultiplexer. 
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Figure 3 schematically illustrates the fetch stage of an instruction pipeline in more 
detail. Fetching logic 60 fetches fixed length instruction words from a memory system and 
supplies these to an instruction word buffer 62. The instruction word buffer 62 is a swing 
buffer having two sides such that it may store both a current instruction word and a next 
5 instruction word. Whenever the current instruction word has been fully decoded and 
decoding has progressed onto the next instruction word, then the fetch logic 60 serves to 
replace the previous current instruction word with the next instruction word to be fetched 
from memory, i.e. each side of the swing buffer will increment by two in an interleaved 
fashion the instruction words that they successively store, 

10 

In the example illustrated, the maximum instruction length of a Java bytecode 
instruction is three bytes. Accordingly, three multiplexers are provided that enable any three 
neighbouring bytes within either side of the word buffer 62 to be selected and supplied to the 
instruction translator 64. The word buffer 62 and the instruction translator 64 are also 
15 provided with a bypass path 66 for use when native instructions are being fetched and 
decoded. 

It will be seen that each instruction word is fetched from memory once and stored 
within the word buffer 62. A single instruction word may have multiple Java bytecodes read 
20 from it as the instruction translator 64 performs the translation of Java bytecodes into ARM 
instructions. Variable length translated sequences of native instructions may be generated 
without requiring multiple memory system reads and without consuming memory resource or 
imposing other constraints upon the memory system as the instruction translation operations 
are confined within the instruction pipeline. 

25 

A program counter value is associated with each Java bytecode currently being 
translated. This program counter value is passed along the stages of the pipeline such that 
each stage is able, if necessary, to use the information regarding the particular Java bytecode 
it is processing. The program counter value for a Java bytecode that translates into a 
30 sequence of a plurality of ARM instruction operations is not incremented until the final ARM 
instruction operation within that sequence starts to be executed. Keeping the program counter 
value in a manner that continues to directly point to the instruction within the memory that is 
being executed advantageously simplifies other aspects of the system, such as debugging and 
branch target calculation. 
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Figure 4 schematically illustrates the reading of variable length Java bytecode 
instructions from the instruction bxiffer 62. At the first stage a Java bytecode instruction 
having a length of one is read and decoded. The next stage is a Java bytecode instruction that 

5 is three bytes in length and spans between two adjacent instruction words that have been 
fetched from the memory. Both of these instruction words are present within the instruction 
buffer 62 and so instruction decoding and processing is not delayed by this spanning of a 
variable length instruction between instruction words fetched. Once the three Java bytecodes 
have been read from the instruction buffer 62, the refill of the earlier fetched of the instruction 

10 words may commence as subsequent processing will continue with decoding of Java 
bytecodes from the following instruction word which is already present. 

The final stage illustrated in Figure 4 illustrates a second three bytecode instruction 
being read. This again spans between instruction words. If the preceding instruction word 

15 has not yet completed its refill, then reading of the instruction may be delayed by a pipeline 
stall until the appropriate instruction word has been stored into the instruction buffer 62. In 
some embodiments the timings may be such that the pipeline never stalls due to this type of 
behaviour. It will be appreciated that the particular example is a relatively infrequent 
occurrence as most Java bytecodes axe shorter than the examples illustrated and accordingly 

20 two successive decodes that both span between instruction words is relatively uncommon. A 
valid signal may be associated with each of the instruction words within the instruction buffer 
62 in a manner that is able to signal whether or not the instruction word has appropriately 
been refilled before a Java bytecode has been read from it. 

25 Figure 5 shows a data processing system 102 including a processor core 104 and a 

register bank 106. An instruction translator 108 is provided within the instruction path to 
translate Java Virtual Machine instructions to native ARM instructions (or control signals 
corresponding thereto) that may then be supplied to the processor core 104. The instruction 
translator 108 may be bypassed when native ARM instmctions are being fetched from the 

30 addressable memory. The addressable memory may be a memory system^such as a cache 
memory with further off-chip RAM memory. Providing the instruc!i^>n translator 108 
downstream of the memory system, and particularly the cache memory, allows efficient use to 
be made of the storage capacity of the memory system since dense instructions that require 
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translation may be stored Avithin the memory system and only expanded into native 
instructions inmiediately prior to being passed to the processor core 104. 

The register bank 106 in this example contains sixteen general purpose 32-bit 
5 registers, of which four are allocated for use in storing stack operands, i.e. the set of registers 
for storing stack operands is registers RO, Rl, R2 and R3. 

The set of registers may be empty, partly filled with stack operands or completely 
filled with stack operands. The particular register that currently holds the top of stack 

10 operand may be any of the registers within the set of registers. It will thus be appreciated that 
the instruction translator may be in any one of seventeen different mapping states 
corresponding to one state when all of the registers are empty and four groups of four states 
each corresponding to a respective different number of stack operands being held within the 
set of registers and with a different register holding the top of stack operand. Table 1 

15 illustrates the seventeen different states of the state mapping for the instruction translator 108. 
It will be appreciated that with a different niunber of registers allocated for stack operand 
stor^e, or as a result of constraints that a particular processor core may have in the way it can 
manipulate data values held within registers, the mapping states can very considerably 
depending upon the particular implementation and Table 1 is only given as an example of one 

20 particular implementation. 
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RO = EMPTY 

Rl = EMPTY 

R2 «= TOS 

R3 = EMPTY 

5 

STATE coin 

RO = EMPTY 

Rl = EMPTY 

10 R2 = EMPTY 

• R3 TOS 



RO « EMPTY 
Rl = TOS-1 
R2 = TOS 
R3 = EMPTY 

STATE 01011 

RO = EMPTY 
Rl = EMPTY 
R2 = TOS-1 
R3 « TOS 



RO » TOS-2 
Rl = TOS-1 

R2 TOS 
R3 - EMPTY 

STATE 01111 

RO « EMPTY 
Rl « TOS-2 
R2 = TOS-1 
R3 « TOS 



RO « TOS-2 
Rl « TOS-1 

R2 = TOS 
R3 = TOS-3 

STATE 10011 

RO = TOS-3 
Rl = TOS-2 

R2 =^ TOS-1 
R3 TOS 



TABLE 1 

15 Within Table 1 it may be observed that the first three bits of the state value indicate 

the number of non-empty registers within the set of registers. The fmal two bits of the state 
value indicate the register number of the register holding the top of stack operand. In this 
way, the state value may be readily used to control the operation of a hardware translator or a 
software translator to take account of the currently occupancy of the set of registers and the 

20 current position of the top of stack operand. 



As illustrated in Figure 5 a stream of Java bytecodes Jl, J2, J3 is fed to the instruction 
translator 108 from the addressable memory system. The mstruction translator 108 then 
outputs a stream of ARM instructions (or equivalent control signals, possibly extended) 

25 dependent upon the input Java bytecodes and the instantaneoxis mapping state of the 
mstruction translator 8, as well as other variables. The example illustrated shows Java 
bytecode Jl being mapped to ARM instructions A' 1 and A*2. Java bytecode J2 maps to 
ARM instructions A^l, A^2 and A^3. Finally, Java bytecode J3 maps to ARM instruction 
A^l. Each of the Java bytecodes may require one or more stack operands as inputs and may 

30 produce one or more stack operands as an ou^nt. Given that the processor core 104 in this 
example is an ARM processor core having a load/store architecture whereby only data values 
held within registers may be manipulated, the instruction translator 108 is arranged to 
generate ARM instructions that, as necessary, fetch any required stack operands into the set of 
registers before they are manipulated or store to addressable memory any currently held stack 

35 operands within the set of registers to make room for resuU stack operands that may be 
generated. It will be appreciafed that each Java bytecode may be considered as having an 
associated "require full" value indicating the number of stack operands that must be present 
within the set of registers prior to its execution together with a "require empty" value 
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indicating the number of empty registers within the set of registers that must be available 
prior to execution of the ARM instructions representing the Java opcode. 

Table 2 illustrates the relationship between initial mapping state values, requh-e full 
5 values, final state values and associated ARM instructions. The initial state values and the 
final state values correspond to the mapping states illustrated in Table 1. The instmction 
translator 108 determines a require fiill value associated with the particular Java bytecode 
(opcode) it is translating. The instruction translator (108), in dependence upon the initial 
mapping state that it has, detennines whether or not more stack operands need to be loaded 
10 into the set of registers prior to executing the Java bytecode. Table 1 shows the initial states 
together with tests applied to the require fiill value of the Java bytecode that are together 
applied to determine whether a stack operand needs to be loaded into the set of registers using 
an associated ARM instruction (an LDR instruction) as well as the final mapping state that 
will be adopted after such a stack cache load operation. In practice, if more than one stack 
15 operand needs to be loaded into the set of registers prior to execution of the Java bytecode, 
then multiple mapping state transitions will occxir, each with an associated ARM instruction 
loading a stack operand into one of the registers of the set of registers. In different 
embodiments it may be possible to load multiple stack operands m a single state transition 
and accordingly make mapping state changes beyond those illustrated in Table 2. 



20 





INITIAL 


REQUIRE 


FINAL 


ACTIONS 








STATE 


FULL 


STATE 












00000 


>0 


00100 


LDR 


RO, 


(Rstack, 


#-4] ! 




00100 


>1 


01000 


LDR 


R3, 


[Rstack, 


#-4] ! 


25 


01001 


>2 


01101 


LDR 


R3, 


[Rstack, 


#-4] 1 




OHIO 


>3 


10010 


LDR 


R3, 


[Rstack, 


#-4] ! 




01111 


>3 


10011 


LDR 


RO, 


[Rstack, 


#-4] ! 




01100 


>3 


10000 


LDR 


Rl, 


[Rstack, 


#-4] ! 




01101 


>3 


10001 


LDR 


R2, 


[Rstack, 


#-4] ! 


30 


01010 


>2 


OHIO 


LDR 


RO, 


[Rstack, 


#-4] ! 




01011 


>2 


01111 


LDR 


Rl, 


[Rstack, 


#-4] ! 




01000 


>2 


01100 


LDR 


R2, 


[Rstack, 


#-4] ! 




00110 


>1 


01010 


LDR 


Rl, 


[Rstack, 


#-4) 1 




00111 


>1 


01011 


LDR 


R2, 


[Rstack, 


#-4] ! 


35 


00101 


>1 


01001 


LDR 


RO, 


[Rstack, 


#-4] 1 








TABLE 2 











As will be seen from Table 2, a new stack operand loaded into the set of registers 
40 storing stack operands will form a new top of stack operand and this will be loaded into a 
particular one of the registers within the set of registers depending upon the initial state. 
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Table 3 in a similar manner illustrates the relationship between initial state, require 
empty value, final state and an associated ARM instruction for emptying a register within the 
5 set of registers to move between the initial state and the final state if the require empty value 
of a particular Java bytecode indicates that it is necessary given the initial state before the 
Java bytecode is executed. The particular register values stored off to the addressable 
memory with an STR instruction will vary depending upon which of the registers is the 
current top of stack operand. 



INITIAL 


REQUIRE FINAL 


ACTIONS 






STATE 


EMPTY 


STATE 








00100 


>3 


00000 


STR RO, 


[Rstack] , 


#4 


01001 


>2 


00101 


STR RO, 


[Rstack] , 


#4 


OHIO 


>1 


01010 


STR RO, 


[Rstack] , 


#4 


10011 


>0 


01111 


STR RO, 


[Rstack] , 


#4 


10000 


>0 


01100 


STR Rl, 


[Rstack] , 


#4 


10001 


>0 


01101 


STR R2, 


[Rstack] , 


#4 


10010 


>0 


OHIO 


STR R3, 


[Rstack] , 


#4 


01111 


>1 


01011 


STR Rl, 


[Rstack] , 


#4 


01100 


>1 


01000 


STR R2, 


[Rstack] , 


*4 


01101 


>1 


01001 


STR R3, 


[Rstack] , 


#4 


01010 


>2 


00110 


STR Rl, 


[Rstack] , 


#4 


01011 


>2 


00111 


STR R2, 


[Rstack] , 


#4 


01000 


>2 


00100 


STR R3, 


[Rstack] , 


#4 


00110 


>3 


00000 


STR R2, 


[Rstack] , 


#4 


00111 


>3 


00000 


STR R3, 


[Rstack] , 


#4 


00101 


>3 


00000 


STR Rl, 


[Rstack] , 


#4 






TABLES 









It will be appreciated that in the above described example system the require full and 
require empty conditions are mutually exclusive, that is to say only one of the require full or 
require empty conditions can be true at any given time for a particular Java bytecode which 

35 the instruction translator is attempting to translate. The instruction templates used by the 
instruction translator 108 together with the instructions it is chosen to support with the 
hardware instruction translator 108 are selected such that this mutually exclusive requirement 
may be met. If this requirement were not in place, then the situation could arise in which a 
particular Java bytecode required a number of input stack operands to be present within the 

40 set of registers that would not allow sufficient empty registers to be available after execution 
of the mstruction representing the Java bytecode to allow the results of the execution to be 
held within the registers as required. 
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It will be appreciated that a given Java bytecode will have an overall nett stack action 
representing the balance between the number of stack operands consumed and the number of 
stack operands generated upon execution of that Java bytecode. Since the number of stack 

5 operands consumed is a requirement prior to execution and the number of stack operands 
generated is a requirement after execution, the require fiill and require empty values 
associated with each Java bytecode must be satisfied prior to execution of that bytecode even 
if the nett overall action would in itself be met. Table 4 illustrates the relationship between an 
initial state, an overall stack action, a fmal state and a change in register use and relative 

10 position of the top of stack operand (TOS), It may be that one or more of the state transitions 
illustrated in Table 2 or Table 3 need to be carried out prior to carrying out the state 
transitions illustrated in Table 4 in order to establish the preconditions for a given Java 
bytecode depending on the require full and require empty values of the Java bytecode. 



INITIAL 


STACK 


FINAL 


ACTIONS 








STATE 


ACTION 


STATE 












00000 


+1 


00101 


Rl 


<- TOS 








00000 


+2 


01010 


Rl 


<- TOS-1, R2 


<- TOS 






00000 


+3 


01111 


Rl 


<- TOS-2, R2 


<- TOS- 


1, R3 


<- TOS 


00000 


+4 


10000 


RO 


<- TOS, Rl TOS-3, 


R2 <- 


■ TOS-2, 


00100 


+1 


01001 


Rl 


<- TOS 








00100 


+2 


OHIO 


Rl 


<- TOS-1, R2 


<- TOS 






00100 


+3 


10011 


Rl 


<- TOS-2, R2 


<- TOS-1, R3 


<- TOS 


00100 


-1 


00000 


RO 


<- EMPTY 











01001 


+1 


OHIO 


R2 


<- 


TOS 














01001 


+2 


10011 


R2 


<- 


TOS-1, 


R3 


<- 


TOS 






30 


01001 


-1 


oolod 


Rl 


<- 


EMPTY 














01001 


-2 


00000 


RO 


<- 


EMPTY, 


Rl 


<- 


EMPTY 








OHIO 


+ 1 


10011 


R3 


<- 


TOS 














OHIO 


-1 


01001 


R2 


<- 


EMPTY 












35 


OHIO 


-2 


00100 


Rl 


<- 


EMPTY, 


R2 


<- 


EMPTY 








OHIO 


-3 


00000 


RO 


<- 


EMPTY, 


Rl 


<- 


EMPTY, 


R2 


<- EMPTY 




10011 


-1 


OHIO 


R3 


<~ 


EMPTY 














10011 


-2 


01001 


R2 


<- 


EMPTY, 


R3 


<~ 


EMPTY 






40 


10011 


-3 


00100 


Rl 


<- 


EMPTY, 


R2 


<- 


EMPTY, 


R3 


<- EMPTY 




10011 


-4 


00000 


RO 


<- 


EMPTY, 


Rl 


<- 


EMPTY, 


R2 


<- EMPTY, 



EMPTY 



10000 


-1 


01111 


RO 


<- 


EMPTY 










10000 


-2 


01010 


RO 


<>- 


EMPTY, 


R3 


<- EMPTY 






10000 


-3 


00101 


RO 


<- 


EMPTY, 


R2 


<- EMPTY, 


R3 <- 


EMPTY 


10000 


-4 


00000 


RO 


<- 


EMPTY, 


Rl 


<- EMPTY, 


R2 <- 


EMPTY, R3 < 



EMPTY 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



10001 


-1 


01100 


10001 


-2 


01011 


10001 


-3 


00110 


10001 


-4 


00000 


10010 


-1 


01101 


10010 


-2 


01000 


iUU J. u 


— •^ 


nm 1 1 


10010 


-4 


00000 


01111 


+1 


10000 


mill 




01010 


01111 


-2 


00101 


01111 


-3 


00000 


01100 


+1 


10001 


01100 


-1 


01011 


01100 


-2 


00110 


01100 


-3 


00000 


01101 


+1 


10010 


\j i.±\j ± 




01000 


01101 


-2 


00111 


01101 


-3 


00000 


01010 


+ 1 


01111 


VL\J±\J 


4-9 




01010 


-1 


00101 


01010 


-2 


00000 


01011 


+ 1 


01100 


01011 


+2 


10001 


01011 


-1 


00110 


01011 


-2 


00000 


01000 


+1 


01101 


01000 


+2 


10010 


01000 


-1 


00111 


01000 


-2 


00000 


00110 


+1 


01011 


nni 10 

VV/ X X V 


+2 


01100 


00110 


+3 


10001 


00110 


-1 


00000 


00111 


+ 1 


01000 


00111 


+2 


01101 


00111 


+3 


10010 


00111 


-1 


00000 


00101 


+ 1 


01010 


00101 


+2 


01111 


00101 


+ 3 


10000 


00101 


-1 


00000 



Rl <- EMPTY 

RO <- EMPTY, Rl <- EMPTY 
RO <- EMPTY/ Rl <- EMPTY, R3 <- EMPTY 
RO <- EMPTY, Rl <- EMPTY, R2 <- EMPTY, R3 <- 

EMPTY 

R2 <- EMPTY 

Rl <- EMPTY, R2 <- EMPTY 
RO <- EMPTY, Rl <- EMPTY, R2 <- EMPTY 
RO <- EMPTY, Rl <- EMPTY, R2 <- EMPTY, R3 <- 

EMPTY 



RO <- TOS 

R3 <- EMPTY 

R2 <- EMPTY, R3 <- 

Rl <- EMPTY, R2 <- 



EMPTY 

EMPTY, R3 <- 



EMPTY 



Rl <- TOS 
RO <- EMPTY 

kO <- EMPTY, R3 <- EMPTY 
RO <- EMPTY, R2 <- EMPTY, 



R3 <- EMPTY 



R2 <- TOS 
Rl <- EMPTY 

RO <- EMPTY, Rl <- EMPTY 

RO EMPTY, Rl <- EMPTY, R3 <- EMPTY 

R3 <- TOS 

R3 <- TOS-1, RO <- TOS 
R2 <- EMPTY 

Rl <- EMPTY, R2 <- EMPTY 
RO <- TOS 

RO <- TOS-1, Rl <- TOS 
R3 <- EMPTY 

R2 <- EMPTY, R3 <- EMPTY 
Rl <- TOS 

Rl <- TOS-1, R2 <- TOS 

RO <- EMPTY 

RO <- EMPTY, R3 <- EMPTY 



R3 <- TOS 
RO <- TOS, R3 <- 
Rl <- TOS, RO <- 
R2 <- EMPTY 



TOS-1 

TOS-1, R3 <- TOS- 



RO <- TOS 
RO <- TOS-1, 
RO <- TOS-2, 
R3 <- EMPTY 

R2 <- TOS 
R2 <- TOS-1, 
R2 <- TOS-2, 
Rl <- EMPTY 



Rl <- TOS 

Rl <- TOS-1, R2 <- TOS 



R3 <- TOS 

R3 <- TOS-1, Rl <- TOS 



TABLE 4 



60 
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It will be appreciated that the relationships between states and conditions illustrated in 
Table 2, Table 3 and Table 4 could be combined into a single state transition table or state 
diagram, but they have been shown separately above to aid clarity. 



5 The relationships between the different states, conditions, and nett actions may be 

xised to define a hardware state machine (in the form of a finite state machine) for controlling 
this aspect of the operation of the instruction translator 108. Alternatively, these relationships 
could be modelled by software or a combination of hardware and software. 

10 There follows below an example of a subset of the possible Java bytecodes that 

indicates for each Java bytecode of the subset the associated require fiill, require empty and 
stack action values for that bytecode which may be used in conjunction with Tables 2, 3 and 
4, 



15 iconst_0 

Operation: 
Stack: 

20 



25 

~- iadd 
Operation: 
30 Stack: 



35 

lload__0 

Operation: 

40 

Stack: 

45 

lastore 

50 Operation: 



Push int constant 

. . . => 

0 

Require-Full = 0 
Require-Empty = 1 
Stack-Action = +1 



Add int 

. . . , valuel, value2 => 
. . . , result 

Require-Full = 2 
Require-Empty = 0 
Stack-Action « -1 



Load long from local variable 



. . . , value. wordl, value. word2 

Require-Full 0 
Require-Empty = 2 
Stack-Action = +2 



Store into long array 
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Stack: 



. arrayref, index, value. wordl, value. word2 => 



10 



15 



20 



25 



land 

Operation 
Stack: 

value2.word2 »> 



iastore 

Operation: 
Stack: 



Require-Full = 4 
Require-Empty = 0 
Stack-Action « -4 



Boolean AND long 

valuel. wordl, valuel . word2, value2 .wordl, 

result .wordl/ result-word2 

Require-Full = 4 
Require-Empty = 0 
Stack-Action = -2 

Store into int array 

arrayref, index, value -> 



30 



35 



40 



ineg 

Operation: 
Stack: 



Re quire -Full = 3 
Require-Empty = 0 
Stack-Action = -3 



Negate int 

. , . , value => 
. . . , result 

Require-Full = 1 
Require-Empty = 0 
Stack-Action = 0 



There also follows example instruction templates for each of the Java bytecode 
45 instructions set out above. The instructions shown are the ARM instructions which 
implement the required behaviour of each of the Java bytecodes. The register field "TOS-3", 
•TOS-2", "TOS-l", "TOS", 'TOS+l" and "TOS+2" may be replaced with the appropriate 
register specifier as read from Table 1 depending upon the mapping state currently adopted. 
The denotation "TOS+n" indicates the Nth register above the register ,cunently storing the top 
50 of stack operand starting from the register storing the top of stack operand and counting 
upwards in register value until reaching the end of the set of registers at which point a wrap is 
made to the first register within the set of registers. 
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10 



15 



20 



25 



iconst_0 


MOV 


tos+1, 


#0 




lload^O 


LDR 


tos+2, 


[vars, 


#4] 




LDR 


tos+1, 


[vars', 


#0] 


iastore 


LDR 


Rtmp2, 


[.tos-2 


/ #4] 




LDR 


Rtmpl, 


[tos-2 


, #0] 




CMP 


tos-1, 


Rtmp2 , 


LSR #5 




BLXCS 


Rexc 








STR 


tos, [Rtmpl, 


tos-1. 


lastore 


LDR 


Rtmp2 , 


[tos-3 


, #4] 




LDR 


Rtmpl, 


[tos-3 


/ #0] 




CMP 


tos-2^ 


Rtmp2, 


LSR #5 




BLXCS 


Rexc 








STR 


tos-1. 


[Rtmpl 


, tos-2 




STR 


tos, [Rtmpl, 


#4] 


iadd 


ADD 


tos-1. 


tos-1. 


tos 


ineg 


RSB 


tos, tos, #0 




land 


AND 


tos-2. 


tos--2, 


tos 




AND 


tos-3. 


tos-3. 


tos-1 



30 



An example execution sequence is illustrated below of a single Java bytecode 
executed by a hardware translation unit 108 in accordance with the techniques described 
above. The execution sequence is shown in terms of an initial state progressing through a 
sequence of states dependent upon the instructions being executed, generating a sequence of 
ARM instructions as a result of the actions being performed on each state transition, the 
whole having the effect of translating a Java bytecode to a sequence of ARM instructions. 



35 



40 



45 



50 



Initial state; 
Instruction: 
1) 

Condition: Require-Full>0 
State Transition: 00000 >0 
ARM Instruction (s) : 



00100 



00000 

iadd ( Require- Ful 1=2, Require-Empty=0, Stack-Action=" 



00100 

LDR RO, [Rstack, #-4] ! 



Next state: 
Instruction: 

1) 

Condition: Requite-Fuli>l 
State Transition: 00100 >1 
ARM Instructions (s) : 



01000 



iadd ( Require- Full'=2, Require-Empty=0, Stack-Action=- 
01000 

LDR R3, [Rstack, #-4] ! 



Next state: 
Instruction: 
1) 

Condition: Stack-Action=»-l 
State Transition: 01000 nl 
Instruction template: 

ADD tos-1, tos-1, tos 
ARM Instructions (s) (after substitution): 



iadd {Require-Tctll«2, Require-Empty=0, Stack-Action= 
00111 
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ADD R3, R3, RO 

Next state: 00111 



5 Figure 6 illustrates in a different way the execution of a number of further Java 

bytecode instructions. The top portion of Figure 6 illustrates the sequence of ARM 
instructions and changes of mapping states and register contents that occur upon execution of 
an iadd Java bytecode instruction. The initial mapping state is 00000 corresponding to all of 
the registers within the set of registers being empty. The first two ARM instructions 
10 generated serve to POP two stack operands into the registers storing stack operands with the 
top of stack "TOS" register being RO. The third ARM instruction actually performs the add 
operation and writes the result into register R3 (which now becomes the top of stack operand) 
whilst consuming the stack operand that was previously held within register Rl, thus 
producing an overall stack action of -1 . 

15 

Processing then proceeds to execution of two Java bytecodes each representing a long 
load of two stack operands. The require empty condition of 2 for the first Java bytecode is 
immediately met and accordingly two ARM LDR instructions may be issued and executed. 
The mapping state after execution of the first long load Java bytecode is 01 101. In this state 

20 the set of registers contains only a single empty register. The next Java bytecode long load 
instruction has a require empty value of 2 that is not met and accordingly the first action 
required is a PUSH of a stack operand to the addressable memory using an ARM STR 
instruction. This frees up a register within the set of registers for use by a new stack operand 
which may then be loaded as part of the two following LDR instructions. As previously 

25 mentioned, the instruction translation may be achieved by hardware, software, or a 
combination of the two. Given below is a subsection of an example software interpreter 
generated in accordance with the above described techniques. 



30 



35 



40 



Interpret 



LDRB 

LDR 

DCD 


Rtmp, [Rjpc, # 
pc, [pc, Rtmp, 
0 


1] ! 
Isl #2] 




DCD 


do_iconst_0 


r 


Opcode 


0x03 


DCD 


do__lloacl__0 


f 


Opcode 


Oxle 


DCD 
DCD 


clo_ia store 
do__la store 


f 
t 


Opcode 
Opcode 


0x4 f 
0x50 


DCD 


do^iadd 


f 


Opcode 


0x60 
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5 do i const 0 



10 



15 



20 



25 



35 



do lload 0 



do iastore 



do Iastore 



do iadd 



30 do_ineg 



do land 



40 State 00000 



DCD 

DCD 

MOV 
STR 
B 

LDMIA 
STMIA 
B 

LDMDB 
LDR 
LDR 
CMP 

BCS 
STR 
B 

LDMDB 

LDR 

LDR 

CMP 

BCS 

STR 

STR 

B 

LDMDB 
ADD 
STR 
B 

LDR 
RSB 
STR 
B 

LDMDB 

AND 

AND 

STMIA 

B 

Interpret LDRB 
LDR 
DCD 



do_ineg 
do land 



; Opcode 0x74 
; Opcode 0x7 f 



RO, #0 

RO, [Rstack], #4 
Interpret 
Rvars, {RO, Rl} 
Rstack!, {RO, Rl } 
Interpret 

Rstackl, (RO, Rl, R2} 
Rtnip2, [rO," #4] 
Rtmpl, [rO, #0] 
Rl, Rtmp2, LSR #5 

ArrayBoundException 
R2, [Rtmpl, Rl, LSL #2] 
Interpret 

Rstack!, {RO, Rl, R2, R3} 

Rtnip2, [rO, #4] 

Rtmplr [rO/ #0] 

Rl, Rtinp2, LSR #5 

ArrayBoundException 

R2, [Rtmpl, Rl, LSL #3] ! 

R3, [Rtmpl, #4] 

Interpret 

Rstack!, (rO, rl) 

rO, rO, rl 

rO, [Rstack], #4 

Interpret 

rO, [Rstack, #-4] ! 

tos, tos, #0 

rO, [Rstack], #4 

Interpret 

Rstackl, {rO, rl, r2, r3} 
rl, rl, r3 
rO, rO, r2 
Rstack!, {rO, rl) 
Interpret 

Rtmp, [Rjpc, #1]! 

PC [pc, Rtmp, Isl #2] 

0 



45 



50 



55 



60 



DCD 


State^ 


_00000_do_iconst_0 


? Opcode 0x03 


DCD 


State_ 


_00000_do_lload_0 


} Opcode Oxle 


DCD 
DCD 


State^ 
State] 


_^00000_do_iastore 
]00000_do_lastore 


; Opcode 0x4 f 
; Opcode 0x50 


DCD 


State^ 


_^00000_do_iadd 


? Opcode 0x60 


DCD 


State^ 


_00000_do_ineg 


; Opcode 0x74 


DCD 


State^ 


_00000_do_land 


; Opcode 0x7 f 



State_00000^ 
State_00000^ 
State 00000 



do_iconst_0 MOV 
B 

do__lload__0 LDMIA 
B 

do iastore LDMDB 



Rl, #0 

State_00101_Interpret 
Rvars, {Rl, R2) 
State_01010_Interpret 
Rstackl, {RO, Rl, R2} 
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LDR 


Rtmp2, [rO, #4] 












LDR 


Rtmpl, [rO, #0] 












CMP 


Rl, Rtmp2, LSR #5 












BCS 


ArrayBoundException 






5 






STR 


R2, [Rtmpl, Rl/ LSL #2] 












B 


State 00000 Interpret 








State_ 


0 0 0 0 0_clo_l a s t or e 


LDMDB 


Rstack!, {RO, Rl, R2, R3} 












LDR 


Rtnip2, [rO, #4] 












LDR 


Rtmpl, [rO, #0] 






10 






CMP 


Rl, Rtinp2, LSR #5 












BCS 


ArrayBoundException 












STR 


R2, [Rtmpl, Rl, LSL #3] 1 












STR 


R3, [Rtmpl, #4] 












B 


State OO000_Interpret 






15 


State^ 


O0000_do_iacid 


LDMDB 


Rstack!, {Rl, R2) 












ADD 


rl, rl, r2 












B 


State 00101_Interpret 








State^ 


00000 do_ineg 


LDR 


rl, [Rstack, #-4]! 












RSB 


rl, rl, #0 
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10 

Figure 7 illustrates a Java bytecode instruction "laload" which has the function of 
reading two words of data from within a data array specified by two words of data starting at 
the top of stack position. The two words read firom the data array then replace the two words 
that specified their position and to fonn the topmost stack entries. 

15 

In order that the "laload" instruction has sufficient register space for the temporary 
storage of the stack operands being fetched from the array without overwriting the input stack 
operands that specify the array and position within the array of the data, the Java bytecode 
instruction is specified as having a require empty value of 2, i.e. two of the registers within 
20 the register bank dedicated to stack operand storage must be emptied prior to executing the 
ARM instructions emulating the "laload'' instruction. If there are not two empty registers 
when this Java bytecode is enconntered, then store operations (STRs) may be performed to 
PUSH stack operands currentiy held within the registers out to memory so as to make space 
for the temporary storage necessary and meet the require empty value for the instruction. 

25 

The instruction also has a require full value of 2 as the position of the data is specified 
by an array location and an index within that array as two separate stack operands. The 
drawing illustrates the first state as already meeting the require fnll and requh-e empty 
conditions and having a mapping state of "01001". The "laload" instruction is broken down 
3D into three ARM instructions. The first of these loads the array reference mto a spare working 
register outside of the set of registers acting as a register cache of stack operands. The second 
instruction then uses this array reference in conjunction with an index value within the array 
to access a first array word that is written into one of the empty registers dedicated to stack 
operand storage. 

35 

It is significant to note that after the execution of the first two ARM instructions, the 
mapping state of the system is not changed and the top of stack pointer remains where it 
started with tiie registers specified as empty still being so specified. 
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The final instruction within the sequence of ARM instructions loads the second array 
word into the set of registers for storing stack operands. As this is the final mstruction, if an 
interrupt does occur during it, then it will not be serviced until after the instruction completes 
5 ' and so it is safe to change the input state with this mstruction by a change to the mappmg state 
of the registers storing stack operands. In this example, the mapping state changes to "01011" 
which places the new top of stack pointer at the second ^a^ray word and indicates that the input 
variables of the array reference and index value are now empty registers, i.e. marking the 
registers as empty is equivalent to removing the values they held from the stack. 

10 

It will be noted that whilst the overall stack action of the "laload" instruction has not 
changed the number of stack operands held within the registers, a mapping state swap has 
nevertheless occurred. The change of mapping state performed upon execution of the final 
operation is hardwired into the instruction translator as a function of the Java bytecode being 
15 translated and is indicated by the "swap" parameter shown as a characteristic of the "laload" 
instruction. 

Whilst the example of this drawmg is one specific instruction, it will be appreciated 
that the principles set out may be extended to many different Java bytecode instructions that 
20 are emulated as ARM instructions or other types of instruction. 

Figure 8 is a flow diagram schematically illustratuag the above technique. At step 10 a 
Java bytecode is fetched from memory. At step 12 the require full and require empty values 
for that Java bytecode are examined. If either of the require empty or require fiill conditions 
25 are not met, then respective PUSH and POP operations of stack operands (possibly multiple 
stack operands) may be performed with steps 14 and 16. It is will be noted that this particular 
system does not allov/ the require empty and require full conditions to be simultaneously 
uimiet. Multiple passes through steps 14 and 16 may be required until the condition of step 
12 is met 

30 

At step 18, the first ARM instruction specified within the translation template for the 
Java bytecode concerned is selected. At step 20, a check is made as to whether or not the 
selected ARM instruction is the final instmction to be executed in the emulation of the Java 
bytecode fetched at step 10. If the ARM instruction being executed is the final instmction, 
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then step 21 serves to update the program counter value to point to the next Java bytecode in 
the sequence of mstructions to be executed. It will be understood that if the ARM instruction 
is the final instruction, then it will complete its execution irrespective of whether or not an 
interrupt now occurs and accordingly it is safe to update the program counter value to the next 
5 Java bytecode and restart execution from that point as the state of the system will have 
reached that matching normal, uninterrupted, full execution of the Java bytecode. If the test 
at step 20 indicates that the final bytecode has not been reached, then updating of the program 
counter value is bypassed. 

10 Step 22 executes the current ARM instruction. At step 24 a test is made as to whether 

or not there are any more ARM instructions that require executing as part of the template. If 
there are more ARM instructions, then the next of these is selected at step 26 and processing 
is returned to step 20. If there are no more instructions, then processing proceeds to step 28 at 
which any mapping change/swap specified for the Java bytecode concerned is performed in 

15 order to reflect the desired top of stack location and fiill/empty status of the various registers 
holding stack operands. 

Figure 8 also schematically illustrates the points at which an interrupt if asserted is 
serviced and then processing restarted after an interrupt. An interrupt starts to be serviced 

20 after the execution of an ARM instruction currently in progress at step 22 with whatever is the 
current program counter value being stored as a return pomt with the bytecode sequence. If 
the current ARM instruction executmg is the final instruction within the template sequence, 
then step 21 will have just updated the program counter value and accordingly this will point 
to the next Java bytecode (or ARM instruction should an instruction set swtch have just been 

25 initiated). If the currently executing ARM instruction is anything other than the fimal 
instruction in the sequence, then the program counter value will still be the same as that 
indicated at the start of the execution of the Java bytecode concerned and accordingly when a 
return is made, the whole Java bytecode will be re-executed. 

30 Figure 9 illustrates a Java bytecode translation unit 68 that receives a stream of Java 

bytecodes and outputs a translated stream of ARM instructions (or corresponding control 
signals) to control the action of a processor core. As described previously, the Java bytecode 
trai\slator 68 translates simple Java bytecodes using instmction templates into ARM instructions 
or sequences of ARM mstmctions. When each Java bytecode has been executed, then a counter 
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value within scheduling control logic 70 is decremented. When this counter value reaches 0, 
then the Java bytecode translation unit 68 issues an ARM instruction branching to scheduling 
code that manages scheduling between threads or tasks as appropriate. 

Whilst simple Java bytecodes are handled by the Java bytecode translation unit 68 itself 
providing high speed hardware based execution of these bytecodes, bytecodes requiring more 
complex processing operations are sent to a software interpreter provided in the form of a 
collection of interpretation routines (examples of a selection of such routines are given earlier in 
this description). More specifically, the Java bytecode translation unit 68 can determined that the 
bytecode it has received is not one which is supported by hardware translation and accordingly a 
branch can be made to an address dependent upon that Java bytecode where a software routine 
for interpreting that bytecode is found or referenced. This mechanism can also be employed 
when the scheduling logic 70 indicates that a scheduling operation is needed to yield a branch to 
the scheduling code. 

Figure 10 illustrates the operation of the embodiment of Figure 9 in more detail and the 
split of tasks between hardware and software. All Java bytecodes are received by the Java 
bytecode translation unit 68 and cause the counter to be decremented at step 72. At step 74 a 
check is made as to whether or not the counter value has reached 0. If the counter value has 
reached 0 (counting down from either a predetermined value hardwired into the system or a 
value that may be user controlled/programmed), then a branch is made to scheduling code at step 
76. Once the scheduling code has completed at step 76, control is returned to the hardware and 
processing proceeds to step 72, where the next Java bytecode is fetched and the counter again 
decremented. Since the counter reached 0, then it will now roll round to a new, non-zero value. 
Alternatively, a new value may be forced into the counter as part of the exiting of the scheduling 
process at step 76. 

If the test at step 74 indicated that the counter did not equal 0, then step 78 fetches the 
Java bytecode. At step 80 a determination is made as to whether the fetched bytecode is a simple 
bytecode that may be executed by hardware translation at step 82 or requires more complex 
processing and accordingly should be passed out for software interpretation at step 84. If 
processing is passed out to software interpretation, then once this has completed control is 
returned to the hardware where step 72 decrements the counter again to take account of the 
fetching of the next Java bytecode. 

28 
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Figure 1 1 illustrates an alternative control arrangement At the start of processing at step 
86 an instruction signal (scheduling signal) is deasserted. At step 88, a fetched Java bytecode is 
examined to see if it is a simple bytecode for which hardware translation is supported. If 

5 hardware translation is not supported, then control is passed out to the mterpreting software at 
step 90 which then executes a ARM instruction routine to interpret the Java bytecode. If the 
bytecode is a simple one for which hardware translation is supported, then processing proceeds 
to step 92 at which one or more ARM instructions are issued in sequence by the Java bytecode 
translation unit 68 acting as a form of multi-cycle finite state machine. Once the Java bytecode 

10 has been properly executed either at step 90 or at step 92, then processing proceeds to step 94 at 
which the instruction signal is asserted for a short period prior to being deasserted at step 86. 
The assertion of the instruction signal indicates to extemal circuitry that an appropriate safe point 
has been reached at which a timer based scheduling interrupt could take place without risking a 
loss of data integrity due to the partial execution of an interpreted or translated instruction. 

15 

Figure 12 illustrates example circuitry that may be used to respond to the instruction 
signal generated in Figure 1 L A timer 96 periodically generates a timer signal after expiry of a 
given time period. This timer signal is stored within a latch 98 until it is cleared by a clear timer 
interrupt signal. The output of the latch 98 is logically combmed by an AND gate 100 witii the 

20 instmction signal asserted at step 94. When the latch is set and the instruction signal is asserted, 
then an interrupt is generated as the output of the AND gate 100 and is used to trigger an 
intermpt that performs scheduling operations using the interrupt processing mechanisms 
provided within the system for standard interrupt processing. Once the interrupt signal has been 
generated, this in turn triggers the production of a clear timer interrupt signal that clears the latch 

25 98 until the next timer ou^ut pulse occurs. 

Figure 13 is a signal diagram illustrating the operation of the circuit of Figure 12. The 
processor core clock signals occur at a regular frequency. The timer 96 generates timer signals at 
predetermined periods to mdicate that, when safe, a scheduling operation should be initiated. 
30 The timer signals are latched. Instmction signals are generated at times spaced apart by intervals 
that depend upoiThow quickly a particular Java bytecode was executed. A simple Java bytecode 
may execute in a single processor core clock cycle, or more typiceilly two or three, whereas a 
complex Java bytecode providing a high level management type function may take several 
hundred processor clock cycles before its execution is completed by the software interpreter. In 
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either case, a pending asserted latched timer signal is not acted upon to trigger a scheduling 
operation until the instruction signal issues indicating that it is safe for the schedulmg operation 
to commence. The simultaneous occurrence of a latched timer signal and the instruction signal 
triggers the generation of an interrupt signal foUowed immediately thereafter by a clear signal 
that clears the latch 98. 
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CLAIMS 

1 . Apparatus for processing data, said apparatus comprising: 

a processor core operable to execute operations as specified by instructions of a first 
5 instruction set, said processor core having an instruction pipeline into which instructions to be 
executed are fetched from a memory and along which instructions progress; and 

an instruction translator operable to translate mstructions of a second instruction set 
into translator output signals corresponding to instructions of said first instruction set; wherein 
said instruction translator is within said instruction pipeline and translates instructions 
10 of said second instruction set that have been fetched into said instruction pipeline from said 
memory; 

at least one instruction of said second instruction set specifies a multi-step operation 
that requires a plurality of operations that may be specified by instructions of said first 
instruction set in order to be performed by said processor core; and 
15 said instruction translator is operable to generate a sequence of translator output 

signals to control said processor core to perfonn said multi-step operation. 

2. Apparatus as claimed in claim 1, wherein said translator output signals include signals 
forming an instruction of said first instruction set. 

20 

3. Apparatus as claimed in any one of claims 1 and 2, wherein said translator output 
signals include control signals that control operation of said processor core and match control 
signals produced on decoding instructions of said first instruction set, 

25 4. Apparatus as claimed in any one of claims I, 2 and 3, wherein said translator output 
signals include control signals that control operation of said processor core and specify 
parameters not specified by control signals produced on decoding instructions of said first 
instruction set. 

30 5. Apparatus as claimed in any one of the preceding claims, wherein said processor core 
fetches instructions from an instruction address within said memory specified by a program 
counter value held by said processor core. 
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6. Apparatus as claimed in claim 5, wherein, when an instruction of said second 
instruction set is executed, said program counter value is advanced by an amount that is 
independent of whether or not said instruction of said second instruction set specifies a multi- 
step operation. 

7. Apparatus as claimed in any one of claims 5 and 6, wherein, when an instruction of 
said second instruction set is executed, said program counter value is advanced to specify a 
next instruction of said second instruction set to be executed. 

8. Apparatus as claimed in any one of claims 5, 6 and 7, wherein said program counter 
value is saved if an interrupt occurs when executing instructions of said second instruction set 
so and is used to restart execution of said instructions of said second instruction set after said 
interrupt. 

9. Apparatus as claimed in any one of the preceding claims, wherein instructions of said 
second instruction set specify operations to be executed upon stack operands held in a stack. 

10. Apparatus as claimed in any one of the preceding claims, wherein said processor has a 
register bank containing a plurality of registers and instructions of said first instruction set 
execute operations upon register operands held in said registers. 

11. Apparatus as claimed in claim 10, wherein a set of registers within said register bank 
hold stack operands firom a top potion of said stack. 

12. Apparatus as claimed in claims 9 and 11, wherein said instruction translator has a 
plurality of mapping states in which different registers within said set of registers hold 
respective stack operands from different positions within said stack, said instruction translator 
being operable to move between mapping states in dependence upon operations that add or 
remove stack operands held within said stack. 

13. Apparatus as claimed in any one of the preceding claims, further comprising a bypass 
path within said instruction pipeline such that said instruction translator may be bypassed 
when instructions of said second instruction set are not being processed. 



32 



wo 02/29507 



PCT/GBOl/02743 



14. Apparatus as claimed in any one of the preceding claims, wherein said instructions of 
said second instruction set are Java Virtual Machine bytecodes. 

15. A method of processing data using a processor core having an instruction pipelme into 
which instructions to be executed are fetched from a memory and along which instructions 
progress, said processor core being operable to execute operations specified by mstmctions of 
a first mstruction set, said method comprising the steps of: 

fetching instructions into said instruction pipeline; and 

translating fetched instructions of a second instruction set into translator ou^ut signals 
corresponding to instructions of said first instruction set using an instruction translator within 
said instruction pipeline; wherein 

at least one instruction of said second instruction set specifies a multi-step operation 
that requires a plurality of operations that may be specified by instructions of said first 
instruction set in order to be performed by said processor core; and 

said instruction translator is operable to generate a sequence of translator output 
signals to control said processor core to perform said multi-step operation. 

16. A computer program product holding a computer program for controlling a computer 
to perform the method of claim 13. 

17. Apparatus for processing data, said apparatus comprising: 

a processor core operable to execute operations as specified by instmctions of a first 
instruction set, said processor core having an instruction pipeline into which instructions to be 
executed are fetched firom a memory and along which instructions progress; and 

an instruction translator operable to translate instructions of a second instruction set 
into translator output signals corresponding to instructions of said first mstruction set; wherem 

said instructions of said second instmction set are variable length instructions; 

said instruction translator is within said instmction pipeline and translates instructions 
of said second instruction set that have been fetched into a fetch stage of said instruction 
pipeline from said memory; and 

said fetch stage of said instruction pipeline includes an instruction buffer holding af 
least a current instruction word and a next instruction word fetched from said memory such 
that if a variable length instruction of said second instruction set starts within said current 
instruction word and extends into said next instruction word, then said next instruction word 
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is available within said pipeline for translation by said instruction translator without requhing 
a ftirther fetch operation. 

18. Apparatus as claimed in claim 17, wherein said instruction buflfer is a swing buffer. 

5 

19. Apparatus as claimed in any one of claims 17 and 18, wherein said fetch stage 
includes a plurality of multiplexers for selecting a variable length instruction from one or 
more of said current instruction word and said next instruction word. 

10 20. Apparatus as claimed in any one of claims 17, 18 and 19, wherein said mstructions of 
said second instruction set are Java Virtual Machine bytecodes. 

21. Apparatus as claimed in any one of clauns 17 to 20, further comprising a bypass path 
within said instruction pipeline such that said instruction translator may be bypassed when 

15 instructions of said second instruction set are not being processed. 

22. Apparatus as claimed in any one of claims 1 7 to 2 1 , wherein 

at least one instruction of said second instruction set specifies a multi-step operation 
that requires a plurality of operations that may be specified by instructions of said first 
20 instruction set in order to be performed by said processor core; and 

said instruction translator is operable to generate a sequence of translator output 
signals to control said processor core to perform said multi-step operation. 

23. Apparatus as claimed in claim 22 and any one of claims 2 to 12. 

24. A method of processing data using a processor core operable to execute operations as 
specified by mstructions of a fnst instruction set, said processor core having an instruction 
pipeline into which instructions to be executed are fetched from a memory and along which 
instructions progress, said method comprising the steps of: 

fetching instructions into said instmction pipeline; and 

translating fetched instructions of a second instruction set into translator output signals 
corresponding to instructions of said first instruction set using an instruction translator within 
said instruction pipeline; wherein 

said instructions of said second instruction set are variable length instructions; 
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said instruction translator is within said instruction pipeline and translates instructions 
of said second instruction set that have been fetched mto a fetch stage of said instruction 
pipeline from said memory; and 

said fetch stage of said instruction pipeline mcludes an instruction buffer holding at 
5 least a current instruction word and a next instruction word fetched from said memory such 
that if a variable length instruction of said second instruction set starts within said current 
instruction word and extends into said next instruction word, then said next instruction word 
is available withua said pipeline for translation by said mstruction translator without requiring 
a further fetch operation. 

[0 

25. A computer program product holding a computer program for controlling a computer 
to perform the method of claim 24. 
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